INTERACTIVE COUPLED OBJECT SEGMENTATION USING SYMMETRY 

AND DISTANCE CONSTRAINTS 



Payam Bahmanbijari*'^, AlirezaAkhDundi Asl' ^ Hamid Soltardan-Zadeh' 



1,2,3 



^Control and Intelligent PnxessingCaiter of Excdlaice, Electrical and Conpiter Engineering Department, 

University of Tehran, Tehran, Iran 

''■ School of Cognitive Sciences, Institute for Studies in Theoretical Physics and Mathematics (IPM), Tehran, Iran 

^ Image Analysis Laharatory, Radiology Department, Henry Eord Health System, Detroit, Michigan, USA 

PLfciiari(a)ece.r]tac.ir a.akhundi(a)ece.ut.ac.ir hszadeti@ut.ac.ir 



Abstract-In this paper, we introduce a novel interactive method 
based on symmetry and distance constraints for the 
segmentation of medical images. Our new symmetry interaction 
and distance constraint are integrated with the Herbulot's 
entropy minimization and Chen's shape-prior segmentation 
methods. This incorporates knowledge-based constraints that 
increase the accuracy and reduce the initialization dependency. 
We applied our algorithm to segment ventricle and caudate in 
magnetic resonance images (MRI) of the brain. Comparative 
results show the effects of the proposed constraints. More 
accurate results and less dependency to initialization are 
obtained when using the proposed method. 

Ke^Mods - Segmentation, Initial Contour, Entropy, Symmetry 
Interaction, Magnetic Resonance Imaging (MRI) 

I. Introduction 

Medical image segmentation is one of the growing 
domains of image processing. In this field, extracting 
stmctures and pathology features, using magnetic resonarxe 
images (MRI), are challaiging problems. The evolving 
contour (snate) was first introduced ty Kass andTerzopoulos 
in 1988 [1]. Based on their work, mar:y other segmentation 
methods were proposed that mairiy utilize image information 
to evolve the segmenting curve [2]-[4]. 
Using just boundary information [3],[4], or region-based 
information [5],[6], often does not lead to perfect results. This 
is because of the low signal to noise ratio (SNR), field 
inhomogeneily, and low contrast between the soft tissues of 
the brain Under such condition, the use of a prior shape 
model is necessary to restrict the deformation between llie 
reference curve and the evolving contour. This segmentation 
method was limited to the parametric deformation between 
the reference shape and the evolving contour with restrictive 
deformation [7]. Other methods use a sh^De prior as a 
functional of the distance between the evolving contour and 
the reference curve [8]. Althouc^ using sh^3e-prior 
segmentation increases the accuracy but there are additional 
prior anatomical krx)\\dedge that can further inpnve 
segmentation of specific stmctures, e.g., symmetry of the 
stmctures on the two sides of a normal train 

In all of the mentioned methods, it is assumed that the 
initial contour is placed in an appropriate position with 
respect to the stmcture of interest Eor esanple, an 
initialization \\iiose one half is in one stmcture and the other 
half in the other stmcture does not guarantee an ^jpropriate 
segmentation In this p^Der, using a criterion based on 
aitropy [9], we propose a symmetric interacting prior-sh^3e 
model for segmentation 
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In this method, we segment double-sided stmctures 
accurately. We conpare the results of using the symmetry 
interaction in the segmentation of caudate and ventricles with 
nor>interactive segmentation In addition, we propose a 
distance criterion to segment caudate and vaitricles, while 
the initial contours are located exactly in both caudate and 
ventricle. The rest of this p^3er is organized as follows. In the 
next section, the level set method and entropy are discussed 
briefly. The proposed method is explained in Section III. 
Results and conclusion are presented afterwards. 

II. LEVEL SET METHOD AND ENTROPY CRITERION 

A. Level set method 

Level set method was first introduced by Osher and 
Sethian in 1988 [10]. Using an appropriate embedding 
function ,^:lx[0 T]->R, it is possible to implicitly, 
propagate boundaries C(t) in the image plane. 
Q(t) ={xel \(^{x,t) = 0}. In order to solve the equation 
of the evolution, the level set theory is used. The active 
contour is equal to zero crossing of a higher dimensional 
signed distance function (?5(x,t) . 

^ Can be any function but because of its properties a 
distance function is used [11]. Solving the Euler equation for 
(^ and finding pixels in which (^ equals to zona yields the 
boundary [10], [11]. 

aT 

(^ is the Level set function, F is the evolving force that 
forces the contour into the desired boundaries. 



:F|Vf^| 



(1) 



B. Entropy Criterion 

In our method, a functional based on the information 
theory is used. This is the first term in our energy 
minimization and is based on the work by Herbulot et al [9]. 
The function that represents the entropy of the image is [9]: 
<p{q{Hx),n)) = -q(/(x),Q)ln(q(;(x),Q)) = E,„, (2) 

where c;(/(x),Q) is the probability density function of the 

image in the region Q. It is estimated using the Parzen 
window method. 

q(I(x),Q) = 7^\K(I(x)-I(x))dx (3) 

Pin 

where K represents the G aussian kernels with 0-mean and 
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(J -variance. Using the shape gradient method and a dynamic 
scheme, the criterion can be modified as follows: 

J(Q(r))= j(9>((?(;(x),Q(r)))dx (4) 

where the region Q becomes continuously dependent on an 
evolution parameterr . In order to define the curve evolution 

equation ] (Q(r)) must be differentiated with respect to r . 

Based on [9],[12], the derivative is : 



\q> (q(7(s),Q)(V.JV)ds 



(5) 



where AT is the unit inward normal of the contour and 
(p\[([[l[\),Q.),V) represents the derivative of cp in the 

direction of V . 

Computing the domain derivative ^' [9],[12],[13], the 
following equation is obtained for the evolution of the 



contoun 



5r 



-q(7(x,Q))(lnq(!(x,Q)) + l)- 



1 



(£(Q)-1 



(6) 



"'""'" at |Q| 

+ j ]i:(7(x)-7(x))lnq(7(x),Q)c/x]]V 

Therefore, the region-based criterion in our method is 
defined as [9]: 

;(Q,„,Q„ J =£,"■"+£,"- (7) 

As mentioned in [9], this is a competition between the 
background and the object region, but since symmetry 
criterion is used in our method, the term {}jis, which 

minimizes the length of the contour, is omitted. 



III. PROPOSED METHOD 

Our proposed method is an appropriate method especially for 
the segmentation of structures which are adjacent and also 
identical on both sides of the brain. Almost all the current 
methods depend on the initial contour and this dependency 
increases when segmentation of two adjacent structures is of 
interest. In such cases, the incorrect attraction of the contour 
to undesired structures is very probable while different 
structures are located around each other. For instance, 
ventricles and caudate are adjacent structures. Since they are 
different and separate structures, an initial contour, having 
intersections with both, should not lead to a mixed or 
overiapped segmentation. In order to avoid such problems, 
we propose a repelling force. 

According to the anatomy texts [14], there exists shape 
symmetry on the two sides of the normal brain. Based on this, 
a symmetry force should improve the segmentation results. 
The benefit of using the symmetry interaction may be shown 
by improperly initializing the contour. Without using the 
symmetry interaction, the algorithm becomes much more 
parameter dependent in such a situation. 



A. Distance Force 

In our work, ventricles and caudate are the structures of 
interests. Clearly, their adjacency increases the difficulty 
especially when the initial contours cover both, such as that 
shown in Figure 1. Cleariy, the green contours which were 
supposed to segment the caudate are evolving incorrectly 
towards the blue contours (see the first row of Figure 2). 
Using the following distance force, the contours gradually 
repel each other until each one is in its related tissue. Suppose 

that Qj is the j evolving contour on the side S of the 

brain. Therefore ^^ is the corresponding signed distance 
function to be used for embedding the contour. Each 
curve Q J separates the image into two regions. 

It is assumed that for 



n] andQ; 

Jin Joi 



all(x,y)eQ^_ ,fj{x,y)<0 and for all(x,y)e Q'.^ , 
fiix,y)>0. 

We introduce a thin band around the zero-level set of the 
Qj astheRepelling-Band: 

Repelling_Band = {(x, y) : \ci] (x, y)\ < 5} (8) 

Using the RepeUing_Band, the distance force Fj is 
introduced as: 






A 



1 + Q){RB) 



Q){RB)<S 



(9) 



other 

where 2 is a fixed constant in our method equal to -1. The 
effect of using the proposed distance constraint is shown in 
Figure 2 (second row). Note that the evolving contours do not 
intersect when the proposed force is used. 

We begin our interactive curve evolution with two separate 
contours for the two structures (ventricles and caudate). Then, 
the symmetry plane is detected based on Liu and Collins' s 
work [15]. Next, the contours are reflected with respect to the 
symmetry plane to segment the structures on 



B. Symmetry Interaction and Prior Shape 




t 



(b) 

Fig. 1 .a. Improperly initialized contours covering both structures 
b. contours are inside each other. 
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the other side of the brain. These steps are summarized below 
and explained in the rest of this section: 

1. Initialization on one side (e.g., right side) 

2. Symmetry plane detection 

3. Reflection and initialization on the other side 

3. shape-prior evolution of the right side based on entropy 
minimization, distance force. 

4. Evolution of the left side, based on entropy 
minimization, distance force using the symmetry interaction. 

B.l. Symmetry plane detection 

There are several methods for the detection of the 
symmetry plane. Some methods maximize of the correlation 
between the image and its reflection with respect to the 
symmetry plane and some optimize other similarity measures 
[16]. We use Liu and Collins's method [14] to find the 
symmetry line (axis) in each slice. Using the symmetry axes 
of all slices, the plane of reflection is found for the entire 
volume. In this method, by rotating and cross-correlating the 
rotated image with its vertical reflection about the center, the 
offsets of the symmetry axis is found; see [14] for more 
details. 

B.2. Symmetry interaction and prior shape 

As mentioned previously, the symmetry criterion is added 
to the evolution the left side contour To this end, the shape 

similarity term is defined for the j ' structure as: 

E,^^^ = L{H[<^j)-H(^f))^dx (10) 

•IQj 

In (10) ^^and (p^ see signed distance functions related to 
the j * structure in the right and left sides of the brain. 





(c) (d) 

. Fig. 2. Improper initialization (a,c). Models are evolving into 
each other (b) . Using distance constrain repels the models from each 
other (d). 



respectively. The Eder-Lagiange equation for updating tfij is 
[9]: 

^sU ='-^ = 2.MH(^j)-H{^f))S{^j) (11) 

\\iiere<j(^j- ) represeits the Dirac delta function, (f>f is chosen 

to be fixed sign distance function for£ j minimization. 

Consequently, combining symmetry force, distance force, 
and the entropy criterion, the following formula describes the 

total evolving force applied to the j left side model. 

pL_pLpLpL (12) 

j sj/nij dj entropjij 

Substituting (/>J withf?^^^^ , prior shape can be developed as: 
flp.,=2xAx(H(^f)-H(^,^^)W«) (13) 

Using F^^pg the evolving force for the j ' right side model 
will be: 

^j ~ F shape j "*" dj +^entropy; y'-^' 

Note that using the same comparison term for both of the 
reference shape and the symmetry interaction reduces the 
necessary calculation. As shown in Figure 3, symmetry 
interaction resultls in more accurate segmentation because of 
less sensitivity to the parameters. 

C. registration and data set 

Using the IBSR [ 17] data set we registered 18 volumes in our 
method We used cardinality metric, in which caudate and 
veifiicle are laheled and the registration metric counts the 
number of corresponding pixels that have the same labels. 
Amoeba method is used in order to optimize the selected 
metric \\d:rich does not require analytical derivatives. ITK [ 18] 
and SPM [ 19] are used for the registration of the labeled data 
set and misegmented volumes, respectively. 

IV. Results 

In this worH the SD-SUcer software [20] is used for showing 
the results. In Figure 4, the final caudate and vaitricle models 
are shown The errors of the extracted structures are 
evaluated using Hausdorff distance method for 




(a) (b) 

Rg. 3. (a) No symmetiy intaaction and inccrrect result of the 
ri^ side contDur (the ei^olutian is corrpletecj . (b) Using symmetry 
inteaction generates conect evolution witiriut einy change of the 
param^ers. 



the image matching and shown in Table 1. In Figure 4, our 
results are shown along with the neurologist segmented 
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structures. The coupled segmented structures are shown in 
Figure 5. 



Table I 

The errors of the structures using Hausdorff distance method. The urrit is Pixel. 



5 

444 
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R.Caudat R.Ventricle L.Caudat L.Ventricle 



V. Conclusion 



Our work has proposed novel methods to overconB two 
inportant proJiems in automatic segmentation of the hrain 
stmctures: inpnper initialization and parameter sensitivity. 
Our results show that using symmetry interaction can guide 
incorrect models to follow the correct ones on the other side 
of the hrain and thus there is rx) need to change the model 
parameters. In addition, the results generated using distance 
criterion with inproper initialization, show the benefit of 
using this constraint 




(a) (b) 

Fig. 4. Final caudateand ventricle on both sides are shown in green 

and blue in (a) and (b), respectively. The neurologist segmentation 

on one side is shown with different opacity (the dark one). 





Fig. 5. Final segmentation of the caudate and vaitricles 
superinpDsed on two of the original images. 
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